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A commentary on 

Brain responses and looking behavior 
during audiovisual speech integration in 
infants predict auditory speech 
comprehension in the second year of life 

by Kushnerenko, E., Tomalski, P., Ballieux, 
H., Potton, A., Birtles, D., Prostick, C, 
et al. (2013). Front. Psychol. 4:432. doi: 
1 0. 3389/fpsyg.201 3. 00432 

Much is known about the development 
of speech perception, but there remain 
gaps in understanding in the devel- 
opment of speech production. Social 
interaction is a popular topic among 
researchers of human development, and 
the development of speech production 
is clearly dependent upon social interac- 
tion (Goldstein et al., 2003; Goldstein and 
Schwade, 2008). The importance of social 
interaction becomes particularly apparent 
when infants begin to speak the language 
of their ambient environment (Lewkowicz 
and Hansen-Tift, 2012). Prior to first 
word production, however, an exchange 
between caregivers and infants occurs, 
such that infant vocalizations and other 
changes in development directly influence 
caregiver responses, which in turn influ- 
ence various components of interaction. 

LOOKING BEHAVIOR AND BRAIN 
RESPONSE 

When presented with audiovisual stim- 
uli of speaking faces between 6 and 12 
months of age, researchers have com- 
piled information on which parts of the 
face infants scan (e.g., around the eyes 
or the mouth), areas of brain activation, 
and associations between looking behavior 
and brain responses with later expressive 



and receptive language abilities. For look- 
ing behavior, a developmental shift in 
attention to audiovisual speech has been 
demonstrated between 4 and 8 months of 
age, with an increase in the time spent 
looking at the mouth as compared to 
eyes (Lewkowicz and Hansen-Tift, 2012). 
Increased looking behavior toward the 
mouth may support understanding of lan- 
guage, as faces convey an abundance of lin- 
guistic information (Wagner et al., 2013). 
Longer time looking to the eyes may indi- 
cate searching for additional social cues 
to resolve ambiguity in audiovisual stimuli 
(Kushnerenko et al., 2013). 

For brain responses, significant neg- 
ative correlations have been observed 
between auditory comprehension scores 
and the amplitude of the infantile P2 
over right frontocentral brain regions in 
response to ambiguous audiovisual speech 
stimuli. The correlation weakens during 
the first year of development, presumably 
as auditory recognition improves. Infants 
with less precise, or less developed audi- 
tory speech processing at 6-9 months of 
age may rely more heavily on visual cues 
when ambiguous speech stimuli are pre- 
sented (Kushnerenko et al., 2013). An 
alternative hypothesis is that infants may 
begin to attend more to the mouth region 
of a communication partner and pro- 
cess audiovisual information outside of 
the right lateralized frontocentral brain 
regions (Kushnerenko et al., 2013). 

PRELINGUISTIC VOCAL DEVELOPMENT 
AND CAREGIVER-INFANT 
INTERACTION 

The shift in visual attention may also be 
related to vocal development. In particular, 
developmental advances occurring with 



respect to speech production between 6 
and 12 months of age directly influence 
caregiver interaction. Caregivers begin to 
attend more, and respond differently to 
well-formed infant productions. This in 
turn, may lead infants to allocate visual 
attention to different regions of the face, 
and hence, encourage the eyes-to-mouth- 
to-eyes attentional shift. 

Infants normally transition through 
several stages of vocal development in the 
first year of life. In the phonation stage, 
from birth to 2 months of age, infants 
gradually become more able to manipu- 
late normal phonation in production of 
quasivowels. In the primitive articulation 
stage, from 1 to 4 months of age, infants 
gradually become more capable of manip- 
ulating their vocal tract during voicing 
in production of "cooing" and "gooing" 
sounds. In the expansion stage, from 3 to 
8 months of age, infants gradually become 
more able to open and posture their vocal 
tract in production of full vowels and 
marginal babbles (Oiler, 2000). During 
these first months of life, caregivers are 
likely to simply gauge infant well-being 
from phonation, and to imitate vocaliza- 
tions produced by the infant (Julien and 
Munson, 2012; Olson and Masur, 2012). 
This sort of action from the caregiver 
does not enhance vocalizations and may 
not draw the infant's attention toward 
the mouth — the visible part of the speech 
mechanism. 

In the canonical stage, from 
approximately 5-10 months of age, infants 
gradually become more able to make well- 
timed movements of their articulators 
from open to closed postures in produc- 
tion of canonical babbling (Oiler, 2000). 
In this final stage, prior to production of 
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words, infants begin to produce syllables, 
potential components of words (Oiler, 
1980; Koopmans-van Beinum and van der 
Stelt, 1986; Stark et al., 1993). When care- 
givers identify these babbled syllables, they 
intuitively begin to interact with the infant 
around them, treating them as potential 
words (Veneziano, 1988; Stoel-Gammon, 
2011). As word learning begins, caregivers 
engage infants, recognizing babbled sylla- 
bles and their potential relation with the 
ambient language (Ramsdell et al., 2012; 
Oiler et al., 2013). In this stage, infant 
vocalizations are well-formed and more 
familiar, and caregivers begin to encourage 
language growth through expanding on 
and enhancing these productions (Gros- 
Louis et al., 2006; Olson and Masur, 2012). 
Simultaneously, infants are learning from 
caregiver input. In a study conducted by 
Goldstein and Schwade, sixty 9.5 month 
old infants were found to begin producing 
more speech-like forms in coordination 
with caregiver response to their vocaliza- 
tions (2008). At this point in development, 
caregiver response to infant vocalizations 
may draw the infant's attention toward the 
mouth, and the infant then receives mul- 
timodal (auditory and visual) feedback 
supporting productions, which in turn 
help to facilitate vocal development. 

Still, there are other interpretations that 
may also contribute to shifts in atten- 
tion. Perhaps not only changing care- 
giver/infant interaction, but also changing 
social-cognitive abilities for joint attention 
later in the first year of development, shift 
attention from the mouth, back to the 
eyes. Infants engage in more joint atten- 
tion episodes between 9 and 12 months of 
age, with improving skill for triadic inter- 
actions from people to objects (Bakeman 
and Adamson, 1984). Further, infants are 
utilizing new forms of nonverbal com- 
munication during interactions, such as 
pointing, showing, and giving (Bates et al, 
1975). During this time, joint attention 
and gesture use occur together with coor- 
dinating eye gaze between objects and 
social partners (Messinger and Fogel, 
1998; Wu and Gros-Louis, 2014). 

CONCLUSION 

As prelinguistic vocalizations develop and 
become well-formed, caregiver responses 



change to teach language. This chang- 
ing caregiver-infant interaction could help 
to guide the infant in attending to dif- 
ferent areas of the face, thereby causing 
processing to shift to different neural cir- 
cuitry. Accordingly, the changes occurring 
in looking behavior and brain responses 
are likely not to be solely dependent upon 
the infants own endogenous attentional 
mechanisms and motivations to vocalize, 
but dependent on caregiver interaction as 
well. 
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